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Abstract 

Several types of stochastic equations are important in thermodynamics, chem- 
istry, evolutionary biology, population dynamics and quantitative social science. 
For systems with pair interactions four different types of equations are derived, 
starting from a master equation for the state space: First, general mean value and 
(co)variance equations. Second, BOLTZMANN-like equations. Third, a master equa- 
tion for the configuration space allowing transition rates which depend on the occu- 
pation numbers of the states. Fourth, a Fokker-Planck equation and a "Boltz- 
mann-Fokker-Planck equation". The interrelations of these equations and the 
conditions for their validity are worked out clearly. A procedure for a selfconsis- 
tent solution of the nonlinear equations is proposed. Generalizations to interactions 
between an arbitrary number of systems are discussed. 

1 Introduction 

Stochastic equations have shown to be a useful tool in all fields of science, where fluc- 
tuations are involved. Many applications can e.g. be found in chemical kinetics [|IJ, laser 
theory M and biological systems ||, but they also become increasingly important in 
quantitative social science f|, ||, || [7], §, || [10|, [TT|| . Without stochastic models certain 



phenomena like phase transitions could not be correctly understood (12], [13], |T3 . 

Most often, problems involving fluctuations are handled by master equations, Fokker- 
Planck equations or Boltzmann equations. There are essentially three ways of arriving 
at these equations: 

• A system is influenced by external fluctuations: In this stochastic differential 

equation (or Langevin equation) would be set up, which can be transformed to a 



Fokker-Planck equation [15, ftE. 



A system consists of a huge number of subsystems: If the entire system behaves 
conservative, it would be described classically by a Liouville equation or quantum 
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mechanically by a von Neumann equation. Both equations can be contracted to 



2(| II, ||, m H, |§ (which becomes 



a (generalized) master equation [|17], [18], [19, 
an ordinary master equation in the Markovian limit [55]) or to a Boltzmann 

The master equation and the Boltzmann 



equation 26, 0, 28, 29, 3C, 31 



equation contain a few relevant (macroscopic) variables only, and handle the huge 
remaining number of irrelevant variables as internal fluctuations. 

The state of a system changes to one of several others with a certain probability which 
depends on the actual state (Markov property): This kind of situation would be 
modelled by a Chapman- Kolmogorov equation, which can be transformed to a 



master equation [5c 



In the following sections the interrelations of master, Fokker-Planck and Boltzmann 
equations shall be discussed (similar considerations can be made for generalized master 



equations | 37fl , generalized Fokker-Planck equations |37 and generalized Boltzmann 
): Starting from the master equation for the state space (sect. 0), the Boltz- 



equations 

mann equation results in the case of a factorization of the pair distribution function (sect. 
|2.2| ), whereas the Fokker-Planck equation follows by a second order Taylor expan- 
sion (sect. H). In addition, a "Boltzmann-Fokker-Planck equation" is derived (sect. 
|3.1|) , which can be either obtained from the Fokker-Planck equation by a factorization 
of the pair distribution function or from the BOLTZMANN equation by a second order TAY- 
LOR expansion. The nonlinear dependence of this equation on the probability distribution 
calls for a selfconsistent method of solution (sect. |3.2| ). 

Having formulated a master equation for the state space, the same can be done for the 
configuration space (occupation numbers' space) (sect. |2]4|). The mean value equation of 
the configurational master equation is equivalent to the Boltzmann equation, if simul- 
taneous interactions of more than two systems are neglected (sect. |2.4| ). The Boltzmann 
equation is applicable only during a certain time interval in which the (co)variances are 
small (sect. |2.4|) . However, the mean value equation can be corrected by methods, which 
are also suitable for calculating the effects of higher order interactions (sect. ^5|) . 



2 The master equation 



Ensembles of statistically behaving systems can often be described by a master equation 

n, m HI 



d_ 

dt 



P{X,t) = I d l X' 



w{X, X'; t)P{X', t) - w(X', X; t)P(X, t) 



with 



0<P(X,t) and d l XP(X,t) = l. 



(2) 



P(X,t) is the probability of the ensemble to be at time t in a state X = (xi, . . . ,xi), if 
a transition from state X to X' occurs with probability w(X' , X;t) per time unit. The 
entire state 

X = [xi] . . . ; x a ; . . . ; xn) 

(-^11) ■ ■ ■ > ^"lnj • • • ) •^a\i ■ ■ ■ 1 ■Eani • • • j ^jVlj • • • i ^Nn) 
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( %al j ■ ■ ■ j X, 



, . . . , jjca i ■ ■ ■ i 



x an ) of the ensemble's N individual 



is combined of the states x a 
systems (/ = n ■ N). 

A typical example for the application of ([I]) is a chemical reaction |39], ^0], II], |52|, 
II 

fi + C^fiC, (3) 

where x a could, for example, indicate, if atom a is bound or free. We would have a discrete 
state space with n = 1 then, and the integrals in (JJ), (|^) could be replaced by sums: 



w(X, X'; t)P(X', t) - X; t)P(X, t) 



x 



Methods for solving master equations are discussed in jig, 47| [48], |23], |49], BO, 51], ^2], [53 



2.1 Mean value equations (Macroscopic equations) 

Usually, one is mainly interested in the time evolution of the mean value 

(/> := j d l Xf(X,t)P{X,t) 

of f(X,t) = x a i. This is given by 

d(Xgi) _ f t dP(X,t) 
dt ~ J ai dt 

= Jd l X J d l X' x ai w(X, X'\ t)P(X', t) - x ai w(X', X- t)P(X, t) 

= J d l X j d l X' {x' ai - x ai )w(X', X- t)P(X, t) 

= J d l Xm ai (X,t)P(X,t) 
= (m ai (X,t)) 

with the first jump moments [3^ 

m ai (X,t) := / d l X'Ax' ai w(X',X;t) (Ax' ai := x' ai - x m ) . 



(4) 



(5) 



In the derivation of (ffl) we have exchanged the order of X and X' . 

If the probability distribution P(X,t) has only small (co)variances, we find in first order 
Taylor approximation the relation 

d{x a i) 



dt 



- < m ai ((X),t)+J2(^j ~ (^)) am ^ (X),t) ) = m ai ((X),t) . (C» 



8.i 



d{x Pj ) 



3 



In many cases, the initial state Xq at a time to is known by measurement or preparation, 
i.e. the initial distribution is 

P(X,t )=5(X-X ) 
with the Dirac delta function S(.). As a consequence, the (co)variances 

^otifHj ■ ((,3'ai (^oi) ) ip^pj (^Aj))^ (p^ai^fij) ip^ai) (p j3j) 

vanish at time t and remain small during a certain time interval. Proceeding as above, 
the equations 



da ni 



aif3j 



^ (m a i/3j(X,t)) + ([x ai - (x a i))mpj{X,t)j + ([xpj - (%))m aj (i, t)J (7) 

for the temporal development of the (co)variances are found |39fl , where 

m m/3j (X,t) := J d l X'Ax' ai Ax' 0j w(X',X;t) (8) 

are the second jump moments. The (co)variance equations (0) have, in first order Taylor 
approximation 



[x ai - (x ai ))f(X,t) 



( (x ai - (x ai ))f{(X),t) + ( 

\ 7, k 



df({x),ty 



d{x lk ) 

df({X),t) 
the form B9| 



(Since equations (|J) and fl7|) are no closed equations, they can only be approximately 
solved.) 



2.2 BOLTZMANN-like equations 

The probability distribution P(X,t) rather than the mean value equations should be 
calculated, if the (co)variances are not negligible. Since the number N of systems is usually 
tremendous, (|l|) can be solved neither exactly nor by computer simulations. In order to 
find a suitable simplification of ([I]), let us introduce the vectors 

X Q :=(0;...;0;x a ;0;...;0), 

k 

j^ai...a k ._ j£c 



k 

~<\, 

=1 
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and let us decompose the transition rates 



N 

w(Y;X;t) = E E w ai .. Mk (f^; X"; t) 



k=l ai<...<a k 

N 



1 

E^ E ^..^(Y^-^x^-^t) 

k = l »l,...,»fc 



(10) 



into terms 



w ai ... ak (Y^- a ";X a ^;t) 
which describe the interactions between exactly k systems. Consequently, we have to set 

w ai ... ak = 0, if two indices ctj, cnj agree. 

For most of the chemical reactions and many other cases the terms with k < 2 are the 
only important ones, because simultaneous interactions between three or more systems 
are rare. Therefore, the terms with k > 2 shall be neglected in the following, but a 
generalization to an arbitrary number of simultaneously interacting systems is possible 
(see sect. |2.5|) [p7| , p8| , |56| , [57| , |58|| . The master equation (^) has then the form 



dt 



,/P(AV/i = ^/rfYU(^;f^t)P(f,t)-^(^;^;t)P(X,t) 

+ \T,j dlY [wp 7 (X^,Y^;t)P(Y,t) -Wp 7 (Y^;X^,t)P(X,t) 



At 



Let us use 



with 



d xp P a ^ p afe {x ai ', ■ ■ ■ , xp ; . . . ; x ak , t) P a ^ ak [x ai ; . . .;x ak ,t) 



• (11) 



(12) 



-fi...jv(^l) ■ ■ ■ ) t) = P(£l) ■ ■ ■ > %N] t) 

and assume the factorization 

P a p(x a ;Xp]t) 7H P a (x a ,t)Pp(xp,t) 



(13) 



of the pair distribution P a p(x a ; xp; t). Integration of (pTTJ ) over all variables xp with (3 ^ a 
leads to [Bm B21 



P a (x a ,t) = Jd n y 



w a {x a , y a , t^)P a (jj a , £) w a (y a , x ai t)P a (x a , t) 



+ fd n y a E fdl^xp w a p(x a , xp] y a , yp\ t)Pp{yp, t) P a (y a , t) 



E jd n yp jd n xpw a p(y a} yp-,x a ,xp]t)Pp(xp,t) ] P a (x a ,t) 



with 



J d x a P a {x ai t) 1 



(14) 



(15) 



where the conventions 



w a (y a ,x a ;t) = w a (Y a ;X a ;t) , 
w a p(y a ,yp;x a ,Xp;t) = w af3 (Y al3 ;X al3 ;t) 

have been used. The second and third terms of ([14]) are similar to those of the Boltz- 



mann equation ]5DL FOL K9j. w a (y a , x a ; t) describes transitions of system a from state x a 
to state y a occuring spontaneously or being induced by external influences. 
w a p{jj ai yp]x ai xp]t) represents interactions between two systems a and (3 changing their 
states from x a resp. xp to y a resp. yp. More clearly arranged, (|I4D can be written in the 
form 

'' ' ' w a (x,x';t)P a (x ,t) - w a (x,x;t)P a (x,t) 



dt 



P a (x,t) = Jd n x' 



with the effective transition rates 

w a (x',x;t) := w a (x',x;t) + J rf V / d n yw a p(x',i/;x,y;t)Pp(y,t). 



(16) 



(17) 



The factorization (|T3| ) is valid, if each two systems a and (3 are statistically independent. 
This is approximately the case in the limit of weak interactions (w a p ~ 0) or, if correlations 
between systems a and (3 due to pair interactions are soon destroyed, e.g. by external 
influences (see also (0)). Equation (|T3| ) is called the assumption of molecular chaos |61 



Without this assumption, equation ([TJP would contain the unknown pair distribution 
P a p(x a , xp, t). However, there are methods of calculating corrections, if the factorization 
(PI) is not valid [g7L f 



(see sect. 12.51). 



2.3 Types of interaction 

Normally, the huge number N of systems a can be divided into A types (resp. sets) 
a which can be characterized by a special kind of interaction. In example (^|), one type 
would consist of molecules B and a second type of molecules C. Let N a denote the number 
of systems a & a (i.e. of type a). This implies 

J2N a = N. 

a=l 

If we assume systems a G a of the same type a to be indistinguishable, we have 

P a = P a if a E a , 

w a = w a if a G a , 

_ ( w a b if ot 7^ /3, a G a, (3 Eb 
^ = \0 ifa = /3, 

where w.. are individual transition rates. We may now introduce the abbreviations 

W a , 

( N b -w ab if b ^ a 

\ (N a - 1) • w ab if b = a . 



W a ■ = 
W ab ■ = 
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Then, from (|16|), (0), flT|) we get 

^P a (f, *) = Jd n x' w a (x, x'; t)P a (x', t) - w a (x' } x; t)P a (x, t) (18) 
with the effective transition rates 

w a (x', x- 1) := w a (x', x- 1) + I dn y' I d n V W M, $\ x, y; t)P b (y, t) (19) 

b J 

and 



J d n xP a {x,t) = 1 



In equations (|18|), ( p^9|) the number of variables has been drastically reduced (if A <^ N 
resp. N a ^> 1). As a consequence, (0), ( P^Q are tractable with analytical or computer 
methods. Especially, for A — 1, w\ = 0, 



c/V / d e y'w u (x',y';x,y) = I d b x / dV ' w u (x,y; x* ,if) 



and 



x := (r, v) 



we obtain the ordinary Boltzmann equation for gases 0, |60[ , where f denotes the place 
and u the velocity of a particle. A recursive method for solving this special case has been 



given by Chapman pi, pB and Enskog [66 . 



2.4 The configuration and its temporal development 

In many cases, we are not interested in the states x a of the single systems a, but in the 
number of systems of type a being in state x (e.g. the number of molecules of type 
B being bound). Let us assume that there is only a finite number S of possible states 
x G {xi, . . . ,xs} (although analogous considerations can be made for a continuum of 
states x). Then, the vector 

n:= (ni ,...,4 s ;...;n4,...,n4 ) = (n 1 ; . . .;n A ) 

of occupation numbers n| shall be called the configuration of the ensemble of systems. 
The configuration space consists of all vectors n obeying the relations 

X s = l 

If we neglect pair interactions for a moment (i.e. if we only take terms of order k = 1, 
w a b = 0), we can assume the individual systems to be statistically independent from each 
other. The probability distribution of the configurations n will then be 

A 

P(n,t) = l[P a (n a ,t) (20) 

a=l 
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with the multinomial distribution IE7 



A "' -P a (x 1 ,t) n ^-...-P a (x s ,tps. (21) 



By differentiation of (^3), fl2T|) and use of ( jig) , we obtain for the temporal change of 
P(n,t) the master equation 



d 
It 



P(n,t) = £ 



w(n, n'; t)P(n', t) — w(n', n; t)P(n, t) 



(22) 



with 



and 



'11 r 



w(n', n; t) 



0<P(n,t), £P(n,t) = l 

n 

n%w a (y, x; t) if n' = 







else . 



(23) 



• • • ) n xsi - - - ' n xxi • • • ) ( n y ~l~ 1); • • • ) (^x 1)) • • • ) %j) • • • > Ti x 1 > • • • > ^xs) ■ 



"j/x ■ • • ■ ) '"15) • • ■ j ' ' ' ' Vy 1 ~v> ' ' ' ' \'"x *■/) • • • 5 '"iji ■ ■ ■ j --iiJ " " " j "xsi 

According to this, the configurational transition rate niw a (y, x;t) — n%w a {y, x;t) is pro- 
portional to the number n a s of systems which can change the state x and proportional to 
the individual transition rate w a (y, x; t). 

The equations for the mean values 

(/> :=J2f(n,t)P(n,t) 



of f(n,t) = n% can be obtained from (H) and the first jump moments 

n> 

= E( A 4^>(4s/'^) 

y,y',b 

= [ n ^ w a(x, m t) ~ n a s w a {y, x; t) 



(24) 



(Here, (n)| denotes the component n| of n.) After substitution of yhy x', the mean value 



equations of (]22|) , (]23|) have the explicit form 



= (mg(n,t)) = J2 w a (x,x';t)(nt,) -w a (x',x;t)(nt) 



(25) 



Therefore, the equations governing the temporal change of the expected fractions (n|) /N a 
agree with (|i~8D, and we have: 

(nl) 

{ -f- = P a (x-,t). (26) 
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Pair interactions 



In order to take pair interactions into account, we apply the method of section [2.2| . The 
master equation (E2|) then reads 



d 
dt 



P(n,t) 



E 



+ 



a,x,a' ,x' 
1 



w(n; t)P{n%^ t) - w{n% a 3 - ft; t)P{n, t) 



a,x,a',x' b,y,b' ,y' 



E E ^^Sj;*)^w*) 



with 



x'y'xy " 



fi&:= (...,«4 + l),...,(n|-l),...), 
(...,(4 + l),...,(n|-l),...,(n5; + l),...,(4-l),...) 



(27) 



Usually, the transition rates will depend on the changing occupation numbers only, which 
results in 



d 
dt 



P(n,t) 



E 



a,x,a' ,x' 



1 



wg,(n a s - 1, 4, + 1; t)P{ni% t) - i^IfasU*; t)P(n, t) 



+ 2 £ 

a,x,a' ,x' b,y,b' ,y' 



xyx' y \ x 



a'b'abi^o! „a „6 



W £'tfx'y( n x : 'i n y'i n x'i n j?i ^jPiPi t) 



analogous to (]TTD . Let us in the following consider the special case 



^'fftv^S'i n l) t) 



y' xy\ x' i y i "xi y i / ' '"x "y 

iV >l - W 



ngw a (^,x;t)8 aa > 
ntw a (x',x;t)5 aa , , 
n%n b gw ab (x', if;x,y] t)5 aa >5 bb/ 

n^-f w afe (f , y'; x, $ t)8 aal 8 bb 

^b 



that means 



?a a 



w(fz', n; t) 



n^w a (x', x; t) if n' = n-,^ 

n^w ab (x', $\ x, y; t) if n' = n%^f$ 



:28i 







else 



(where 5 aa > denotes the Kronecker function). The configurational transition rates are 
proportional to the individual transition rates w a resp. w ab and proportional to the num- 
bers n a s of systems which can change the state x resp. to the numbers n^n b g of possible pair 
interactions between states x and y. Therefore, if n' = n%,g,%%, n^n^w aa (x' , if; x, x; t) has 
to be replaced by n^(n^ — l)w aa (x', $\ x, x; t) in order to exclude self-interactions again. 
However, fl28|) is approximately valid, if rig ^> 1 for all configurations n, where P(n, t) can- 
not be neglected. For simplicity, the validity of this assumption will be also presupposed 
in the following sections. 



9 



Mean value equations (Macroscopic equations) 

Noticing 

WpaW, x'; y, x; t) = w a(3 (x', y;x,y; t) 

(since the transition rates are independent from the arbitrary numeration of the systems), 
the first jump moments can be calculated analogously to equation fl24|). They are found 
to be 

m a M *)=£ [n%nf{x, f ; t) - n%nf{x\ x; t)\ (29) 

x' 

with 

w a (x',x;t) := w a (x',x;t) +J2J2J2 w ^(x',if;x,y;t)-^- (30) 

b y> y N b 

(if A^ a ^> 1). Therefore, the approximate mean value equations (see (^) are 
d 



w a {x, x'; t)(n a g,) - w a {x\ x; t){n a s ) 



(31) 



with the mean transition rates 

( n: 



w a {£ ,x;t) := w a (x,x;t) + J2Y.Y. w ^(x',]f;x,y;t)—^-. (32) 

i — v — * iVf, 
b y' y o 

Again, equations (|3~TD, (^) for the expected fractions (n^) /N a agree with equations (|I"8D, 
(|19|) for the probabilities P a (x,t) if making the identification (^). However, the approxi- 
mate equations (|3l|) , (|32|) are only valid under the condition 

which obviously corresponds to the factorization assumption (|T3|) . This condition is ful- 
filled if the absolute values of the (co)variances 

<4 = (^4')-K)(4') 

are small, i.e., if 



ab 
°xx> 



«K)(n|,). (33) 



(This is often the case in the thermodynamic limes N — > oo). According to @, approx- 
imate equations for the temporal development of the (co)variances are 

dv%%> ah //-\ .\ / ar9mt((n),t) h r dm%Un),t)\ 

« mS,< <„>, <) + £ («S-f^P + "tS-j^ J < 34 > 

with the second jump moments 

m&ftt) = Y,( A ^Tx(^n%w(n',n-,t) 

w 

= E (An^)l(An^)|^(^, n; f) 
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y,y',c z,z' ,d 
^ab ( <W E 



™> a (£,y;t) +n%w a {y,x;t) 



— ng,w a (x, x'; t) + ntuflx', x; t) 

b } 

+ EE n i;jf w ab(x 1 x f ;y,y';t) + n'i^w ab (y,y';x,x';t) 

y' y b b 

r n 6 , _ n£, 

~EE n 3TT w ab(y,x'-,x,y']t) +n°}-fw ab (x,y ;y,x';t) 



(35) 



The approximate mean value equations ([H]), (|29|) , (|30|) and the approximate (co) variance 
equations fl3~3|), ( |35"D can be generalized to the case of transition rates 

n%w a {x',n%,,x, n|; t) 




if n' = n|/| 

w(n', n; t) = -j 7ifnJw o6 (x', n£,, y" , n\\ x, n% y, n\\ t) if n' = n§,^| (36) 



else. 



This generalization is necessary, if the individual transition rates w a , w a b are themselves 
functions of the occupation numbers. Such cases appear e.g. in quantitative social science, 
where the decisions or the behavior of individuals may depend on the soczoconfiguration 
n | | g § Equations (0) resp. ([31]), (0), (jkj) and fl3|), © can also be 
used for mean field approaches in physics, e.g the Ising model 170, fZlfl . 



2.5 Corrections and higher order interactions 



In section [2.4| the exact mean value equations 

d(n%) 



dt 



m a s (n,t)) 



(37) 



for m^, dependent on (n^n°j). However, the exact 



{mf s ,(n,t)) + (ntmi,(n,t)) + (ni,m a s (n,t)) 



.a^b 



are, according to equations (| 
equation 

dt 

governing the temporal development of (nfn|,) depends on (n|n|/n|„), because of equa- 
tion ([35]). So, we are confronted with the problem of having no closed set of equations. 

Let us consider the general case of up to k interactions. In the master equation 
have then to take the transition rates 



we 



w(n', n; t) 



( a' 

nfwalix'^Xi.t) 
n Z n Z™^(x'i, x' 2 ]Xi,X 2 ] t) 



n 



ax 



a k \X 



1- 



, X^, Xi, 



if n' 
if n' 

Xk ; t) if n' 
else 



n 



n 



a l a 2 ai a.2 



(3* 



% : 



n 



with 



^ a 'l ... a 'k<H ...Ok ._ 
2-1 u^l • •••Kk 



(•••,(4 + l),...,K-l),...,(4 + l),...,(n^-l),...) 



The temporal development of the Zth moments (n^ •. . .-rig) is governed by the equations 

d , „. 



dt^ 



n 



) = EE 



.71 



u>(n', n; t)P(n, t) 



EEf(( A ^)? 1 + "S)-----(( A ^)S + 

. . . ■ n a J w(n! ', n; t)P(n, t) 



n 



—n 



m=l M,, 
I 



E\ / lii ...aj„ ai m + l 

2 y ( 1 v m • n - • . . . • n, 



E 



E 



Here. 



m.* 1 - m (n. 

L im v 



:=E( A ^----'(^)£«'(^^*) 



71;; 



(39) 



are the mth jump moments, and a (I) is the set of all l\ permutations of the indices 
(1, . . . , I). J^M m means the summation over all subsets . . . , i m } of {1, . . . , 1} = {ii, . . . ,ii} 
consisting of m elements. Notice, that the solutions for the moments should, in the case of 
time independent transition rates w(n', ft), converge to certain values in the limit t — > oo, 
since P(n, t) approaches an unique equilibrium distribution JTS . 



Because of (^), the mth jump moments are polynomials of order k of the occupation 
numbers n£ n . Therefore, the equations ([50) for the Zth moments depend on the 1st up to 
the (Z — 1 + fc)th moments. As a consequence, the exact moment equations (|39"D represent 
a closed system of equations only for k = 1 (exclusion of multiple interactions). For 
interactions of up to k > 1 systems we have to take a suitable approximation of (|3~9|) or, 



in other words, of 



n 



EEi" 

m=0 Mm 



«>)+«> 

<%:;>)• 



n- 



(n a >) 



n 



n. 



(40) 
(41) 



(41) is the exact Taylor expansion of (|40|). If we are interested in the 1st up to the jth 
moments (1 < I < j, j > 1), we have essentially two possibilities of getting approximate 
moment equations: 

(a) Replacing all jump moments m^. 1 "'^ m by first order TAYLOR approximations: 

™£ lit ft - ({n), t) + - (nm-^rn^ «n>, t) . 
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Then, the equations for the Zth moments depend on the 1st up to the Zth moments 
only, but each equation is an approximation. This method has been used in sections 



and |2.4|. According to (H), it corresponds to the assumption 



((^;-(^))-...-(n>-(n£)))|<(n^) 



n- 



for 1 < m < k . 



which can be checked by considering the 1st up to the Zcth moments (i.e. j > k). 



(b) Replacing (m> • n>+; • . . . -njj by jth order TAYLOR approximations. Then, 
the equations for the 1st up to the (j — k + l)th moments are exact (see fl4l|)), 
but the equation for an Zth moment depends on the 1st up to the (I — 1 + k)th 
moments, some of which may be determined by approximate equations. Method (b) 
corresponds to the assumption 



' n a Ji _ (n? 1 )) • . . . • (nt lm - (nt lm ))\ < (nt n 



n 7 



for j < m < I — 1 + k 
(42) 

with 1 < I < j. For large m ([|2|) is normally fulfilled: If the (co) variances are small 
in the sense of 



ab 



(43) 



(which is often true in the thermodynamic limes iV — > oo), the absolute value of 




n 



■ 1 x »m ' 



is usually small where -P(n, t) is large [15]. Note, that (|43|) has to be checked only 
for the variances cx^|, since the Cauchy-Schwarz inequality implies 



ab 



o-, 



^ V a xx a x'x' ■ 



As higher order approximation, method (b) will usually yield better results than (a) if 
j > 2. For k = 2 (i.e. pair interactions) and j = 2 it would e.g. result in corrected mean 
value equations (|3~7|), (p9l), flSOp containing terms of the form (rig-rig,). That means, the 
temporal development of the macroscopic quantities (n°?) depend on the fluctuations (resp. 
the variances = {n^n%) — (n%){n%))\ The corrected (co)variance equations resulting 
from method (b) would be 

da tx' „ ^ab //-n cd d 2 mf s ,{{n) 1 t) f „ ac dmi,((n),t) „ b c dm a s {(n) ,t) \ 

— ~ m^«n>, t) + - ^ ^ ^, ^P(4) + ^ d(n$ + *** d(n$ ) 

using 

(nZn%n%) « K)(ng)(n^) + *£g<ng> + <7$g<ng> + <^«> 

and (H). 

Methods (a) and (b) are also applicable in the case of configuration dependent individual 
transition rates (see (|3T)|)). 
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3 The Fokker-Planck equation 



The master equation (TJ) can (by substitution of Z := —AX' = X — X' in the first term 
and of Z := +AX' in the second term) be written in the form 



d l Z 
d l Z 



w(X, X-Z; t)P(X -Z,t)- w(X + Z, X; £)P(X, t) 
w[X-Z\ Z- t]P(X -Z,t)- w[X- Z- t]P(X, t) 



(44) 



with 



w[X;Z;t] :=w(X + Z,X;t) (Z = AX') . 

According to Kramers Jf^] and Moyal |73|, equation (^4|) may be transformed into the 
Fokker-Planck equation 

9 



E 



m ai (X,t)P(X,t) 



1 51 51 ~ ~ 



a,i P,j 



ni, 



aif3j 



(X,t)P(X,t) 



(45) 

by a second order Taylor approximation. This approximation will be the better the 
smaller the (co)variances (Jaipj are (see the VAN Kampen system size expansion |74] , |39j |15|1 
for a more systematic derivation). However, the Fokker-Planck equation implies the 
same mean value and (co) variance equations as the master equation [54], and is compatible 
with 



< P(X,t) 



d l XP(X,i) = 1 



(see the Pawula theorem [^]). Interpreting equation (|45|) , m 
of drift coefficients and m a i^j (see (|J)) the meaning of diffusion coefficients |37], [39 



(see (|5])) have the meaning 



The Fokker-Planck equation corresponding to the master equation (p2|), ( p8[) is 

d 



d s 



E 



9n5 



m a g (n,t)P(n,t) 



ly T _d__d_ 



m%{n,t)P{n,t) 



(46) 



(Equation (|46|) should be transformed to variables := n^/N a . These variables can be 
approximately handled as continuous ones; see [54|.) 

A reason for using the Fokker-Planck equation instead of the master equation is the 
variety of methods existing for its solution |37], [75|, [15], |76], [FT], [78], [79|, |80|, since it is a partial 
differential equation. Especially, the Fokker-Planck equation has some analogies to the 
Schrodinger equation |37L UB. 



3.1 The "Boltzmann-Fokker-Planck equation" 



We shall now proceed with equation (|45f) as in section [2.2| . Let us decompose the transition 
rates as in equation fllQ|) and neglect interactions of k > 2 systems, again. We find 



m ai (X,t) 
(X,t) 



m 



JaP 



m 



a 

aiaj 



{x a 1 t) + Y.<l aj {x a \t) 



+ <L(x aP ,t) 



14 



with 



m 



m 



m>Jp,t) 



l(X-r s ,t) := Jd l Zz ai w, s [X^;Z^ 5 ;t}, 
(X\t) := J ' d l Zz ai z 0j w 7 [X^;Z^;t] 



mt il3j (X^,t) := fd l Zz ai z f3j w,s[X^;Z^;t}. 



By integration over all variables x@ with (3 7^ a (see fll2|)) and assumption of the factor- 
ization (p~3f) , one obtains 



d ^ d I" d \1 ^ ^ 



2 j j dx a i Ox a j 



with 



M ai (x a ,t) := m*i(x a ,t) + J2 J m ai (x a , x p ,t)P f3 (x f3 , t) , 



%/3 \ m aiaj i, x a ? 3^9 5 t) + m ail3j ( X a ? ) 

/3 



and 

Here, the conventions 



J d x a P a {x a ^ t) 1 . 

m a (x a ,t) = m a (X a ,t), 
m aP {x a ,x p ,t) = m a P{X a ^t) 

have been used. 

Distinguishing A types a of interaction only (see section |2.3| ), we have 

P a = P a if a G a , 
m a = m a if a E a , 



m 



m ab if a ft, a e a, (3 e b 
" if a = (5 . 



Therefore, we arrive at 



2 4^ 



M oij (£, t)P a (x,t) 



(47) 



with the effective drift coefficients 

M ai (x, t) := m a ai (x, t) + £ / d n ym%{x, y, t)P b {y, t) 

b J 

= J d n x' Ax' t w a (x' ,x;t) , 



(48 
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the effective diffusion coefficients 



M aij {x,t) := m a aiaj (x,t) + J2 I *d n y[mli j (xj,t)+m% bj (x,y,tj\p b (y,t) (49) 

b J 

= J d n x' Ax' i Ax' j w a (x',x;t) 

+ E / rfV / ^'j ^ ^x' i Ay' j w ab (x', g; x, y; t)P b {y, t) 



and 



m 
m ab 



m 



N b -m ab if b ^ a 

(N a - l)-m ab if6 = a 



The result (|47|), (f48|) , ([49]) could have also be obtained by a second order Taylor expan- 
sion of the BoLTZMANN-like equations (0), (|I~9"D (compare to [§1], |52|, |g5fl). Therefore, the 
author suggests to term equations (£47|), (||), (£|9]) the "Boltzmann-Fokker-Planck 
equation" . 



3.2 Selfconsistent solution 



Equation ( f47|) is difficult to solve, since it is nonlinear in P a (x, t) due to (f48|) , (f49l) . However, 
the stationary solution P„*(x) of (f4T|) to (f49|) can, with time independent jump moments 
m a (x), m ab (x), be obtained by recursive solution of the linear differential equations 



^dxi 



M^{x)P^(.v) 



h- T— — 

2 Tf cte; dxj 



M k aij {x)P^ l {x) 



k+l. 



(50) 



Here, we have used the definitions 

M*(f) := m a ai (x)+Y: fd n ym: b (x,y)P b k (y), 

b J 

M k ai3 {x) := m a aiaj (x) + £ / >y [m^(x, y) + m^(x, fl] P b \y) 



(51) 



Starting with suitable distributions -P°(x), e.g. the solutions of (f47D with neglected inter- 
action terms (m ab (x,y) =0), we have 



lim P a fe (f) 



if the sequence of functions P*{x) converges. The procedure given by equations (|50|) , 
(|5"1"|) is completely analogous to Hartree's method for calculating selfconsistent fields 
in quantum mechanics |84], |85] . In a slightly generalized form, it can also be used to get 
dynamic solutions P a (x,t). A recursive solution of BoLTZMANN-like equations 
or mean value equations (pll), (B3) is obtained in a similar way. 
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4 Summary and fields of application 



Starting from a master equation for the state space, several equations for statistically be- 
having systems with pair interactions have been derived. For the case of small (co)variances, 
approximate mean value and (co)variance equations have been found. However, if the 
(co)variances are not negligible, BoLTZMANN-like equations are more appropriate. A dras- 
tical reduction of the tremendous number of variables is obtained, if the systems can be 
divided into a few types of interaction. Generalizations to interactions between an arbi- 
trary number of systems have also been discussed. 

Important applications of these equations are not only known from thermodynamics [^, 
|oT| BTJ and chemistry [TJ, fiD], HI], |32L [PL H5[] , but also from mathematical population 
dynamics [54], |86], |87|, |88| and from the biology of evolution [^, |Hj. For example, the 
equation 



w(x, x')P(x', t) — w(x', x)P(x, t) 



+ 



f(x)-J2f(y)P(y,t) 



P(x,t) 



(52a) 
(52b) 



describes mutations by the left-hand side of (52a), and a selection due to pair interactions 
by term (52b) [K^, OT. It results from equations (|T8"D, (|T^) with n — 1, A — 1, u^a;', 2) = 
w(x', and 



wn(x', y'; x, y; t) := max (f(x) - f(y), OjS xx >S xy > + 



max 



- f(x), 0)5 yx >5. 



J yy 



f(x) can be interpreted as the fitness of a species or strategy x and J2 y f{y)P(y, t) = (f) 
as the average fitness. 

In addition, a master equation has been introduced allowing transition rates which depend 
on the occupation numbers of the states. This equation has important applications in 
quantitative social science 0, |5R |5Sl B9j, e.g. opinion formation 



Finally, a Fokker-Planck equation and a "Boltzmann-Fokker-Planck equation" 
for pair interactions have been derived, since they will often be easier solvable or inter- 
pretable than the corresponding master equation resp. BoLTZMANN-like equation. 
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